The BPaaS Evaluation Environment aims at performing an analysis over the information produced during the execution phase of the BPaaS lifecycle in order to discover bottlenecks as well as optimisation points. Such information can then be exploited in a next cycle by the BPaaS Design and Allocation Environments in order to optimize the BPaaS such that it is able to exhibit a particular service level as well as improve the business benefits of the CloudSocket Broker offering it.

To support such analysis, the BPaaS Evaluation Environment follows a multi-layer architecture comprising three main layers: (a) the UI layer which visualizes the results of the analysis; (b) the business logic layer offering the analysis functionality to the layer above, the UI one; (c) the data layer which provides all information required to support the analysis.

The main functional capabilities offered by the BPaaS Evaluation Environment are the following:

- aggregation and decomposition from technical logs up to domain-specific business key performance indicators (KPIs)
- conceptual analytics enabling root cause analysis, drill-down of business KPIs and propagation of technical indicators
- discovery of best deployments for BPaaSs
- detection of event patterns leading to KPI or SLO violations and their mapping to adaptation rules to support both re-active and proactive BPaaS adaptation
- semantic process mining to detect bottlenecks and places for improvement for both BPaaS business processes and workflows.

The core functional capabilities are supported via the following visualisation & data building functionalities:

** semantic lifting of process, service and monitoring logs
** visualisation of a monitoring dashboard that presents a management overview for the BPaaSs running in the cloud

UI Layer

The Hybrid Business Dashboard enables selecting the most suitable analysis techniques and visualises the respective analysis results. It also offers drill-down of business to technical KPIs facilitating the performance of a root cause analysis. In addition, it enables the broker to finalise incomplete KPI specifications.

The dashboard comprises three main views:

# the Business Indicator view enables the visualisation of business and technical goals & KPIs which are represented in different categories. Common representations like traffic lights will be used to indicate whether KPIs are met or violated.
# The Process Deployment/Adaptation Analysis view will visualise in a table-based manner improvement potentials by presenting the findings of the respective analysis performed. There will also be capabilities to sort, search or the export in an appropriate format such findings.
# The Process Mining view visualises the original process model by also assimilating the log mining results into this model in order to highlight deviations from the original design, bottlenecks as well as places for improvement.

Depending on the type of analysis required, the Hybrid Business Dashboard invokes the corresponding component at the next layer, the business logic one, that is the Conceptual Analytics Engine for KPI & best deployment / event pattern analysis and the Process Mining Engine for log mining analysis.